Cognitive human factors in the artificial intelligence of things

© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other worksInternet of Things (IoT) systems are increasingly becoming complex. Heterogeneity in terms of hardware, software, computing capacity and connectivity is a source of complexity. The conversion of IoT systems into cyber-physical systems, including devices that are able not only to collect but also to process and take decisions, in real-time is a second source of complexity. Moreover, not only sensors should be considered, but also actuators, especially robots in the industry domain. In this context Artificial Intelligence (AI) technologies provide powerful capabilities to endow IoT devices with intelligent services, leading to the so-called Artificial Intelligence of Things (AIoT). In this context, the operator/user is in the middle of this complexity trying to understand the current situation and make effective real-time decisions. Hence, human factors, especially the cognitive ones, is a major issue to be addressed. New software development methods in the form of assistants and wizards are necessary to help operators/users to be context-aware and reduce their technical workload about coding or computer-oriented skills, focusing on the task/service at hands.Peer ReviewedObjectius de Desenvolupament Sostenible::9 - Indústria, Innovació i InfraestructuraPostprint (author's final draft

Gaia X: federated open data in a trusted data space

Objectius de Desenvolupament Sostenible::4 - Educació de QualitatObjectius de Desenvolupament Sostenible::10 - Reducció de les Desigualtat

Cognitive robotics and control

Postprint (published version

Real-time model-based video stabilization for microaerial vehicles

The emerging branch of micro aerial vehicles (MAVs) has attracted a great interest for their indoor navigation capabilities, but they require a high quality video for tele-operated or autonomous tasks. A common problem of on-board video quality is the effect of undesired movements, so different approaches solve it with both mechanical stabilizers or video stabilizer software. Very few video stabilizer algorithms in the literature can be applied in real-time but they do not discriminate at all between intentional movements of the tele-operator and undesired ones. In this paper, a novel technique is introduced for real-time video stabilization with low computational cost, without generating false movements or decreasing the performance of the stabilized video sequence. Our proposal uses a combination of geometric transformations and outliers rejection to obtain a robust inter-frame motion estimation, and a Kalman filter based on an ANN learned model of the MAV that includes the control action for motion intention estimation.Peer ReviewedPostprint (author's final draft

Towards modelling group-robot interactions using a qualitative spatial representation

This paper tackles the problem of finding a suitable qualitative representation for robots to reason about activity spaces where they carry out tasks interacting with a group of people. The Qualitative Spatial model for Group Robot Interaction (QS-GRI) defines Kendon-formations depending on: (i) the relative location of the robot with respect to other individuals involved in that interaction; (ii) the individuals' orientation; (iii) the shared peri-personal distance; and (iv) the role of the individuals (observer, main character or interactive). The evolution of Kendon-formations between is studied, that is, how one formation is transformed into another. These transformations can depend on the role that the robot have, and on the amount of people involved.Postprint (author's final draft

A real-time human-robot interaction system based on gestures for assistive scenarios

Natural and intuitive human interaction with robotic systems is a key point to develop robots assisting people in an easy and effective way. In this paper, a Human Robot Interaction (HRI) system able to recognize gestures usually employed in human non-verbal communication is introduced, and an in-depth study of its usability is performed. The system deals with dynamic gestures such as waving or nodding which are recognized using a Dynamic Time Warping approach based on gesture specific features computed from depth maps. A static gesture consisting in pointing at an object is also recognized. The pointed location is then estimated in order to detect candidate objects the user may refer to. When the pointed object is unclear for the robot, a disambiguation procedure by means of either a verbal or gestural dialogue is performed. This skill would lead to the robot picking an object in behalf of the user, which could present difficulties to do it by itself. The overall system — which is composed by a NAO and Wifibot robots, a KinectTM v2 sensor and two laptops — is firstly evaluated in a structured lab setup. Then, a broad set of user tests has been completed, which allows to assess correct performance in terms of recognition rates, easiness of use and response times.Postprint (author's final draft

Real-time video stabilization without phantom movements for micro aerial vehicles

In recent times, micro aerial vehicles (MAVs) are becoming popular for several applications as rescue, surveillance, mapping, etc. Undesired motion between consecutive frames is a problem in a video recorded by MAVs. There are different approaches, applied in video post-processing, to solve this issue. However, there are only few algorithms able to be applied in real time. An additional and critical problem is the presence of false movements in the stabilized video. In this paper, we present a new approach of video stabilization which can be used in real time without generating false movements. Our proposal uses a combination of a low-pass filter and control action information to estimate the motion intention.Peer ReviewedPostprint (published version

Towards robots reasoning about group behavior of museum visitors: leader detection and group tracking

The final publication is available at IOS Press through http://dx.doi.org/10.3233/AIS-170467Peer ReviewedPostprint (author's final draft

Equilibrio del robot AIBO usando DMPs

El trabajo presentado se enmarca en una iniciativa global que tiene como objeto la recuperacion de la plataforma robotica AIBO de Sony. Para demostrar las prestaciones de la arquitectura propuesta y la viabilidad del robot AIBO como plataforma robotica util, se han escogido algoritmos de aprendizaje por refuerzo muy novedosos como implementacion en la tarea de mantener el equilibrio ante movimientos indeseados en la base de apoyo del robot. El robot AIBO puede ser controlado de forma permanente con un tiempo de respuesta adecuado para la tarea.Postprint (published version

Estabilización de vídeo en micro vehículos aéreos y su aplicación en la detección de caras

Actualmente, los vehículos aéreos de micros escala (MAVs) se han tornado populares para múltiples aplicaciones como rescate, vigilancia, mapeo, entre otras. Para todos los casos, es necesario un óptimo desempeño de los vídeos capturados a bordo, y uno de los principales problemas constituyen los movimientos indeseados entre fotogramas consecutivos. Para solventar esta problemática existes diferentes enfoques que, aplicados a post-procesamiento, consiguen una estabilización robusta en la imagen. Sin embargo, muy pocos algoritmos son capaces de ser aplicados en tiempo real. En este artículo se presenta un nuevo enfoque que puede ser implementado en tiempo real sin que se generen movimientos falsos. Nuestra propuesta usa una combinación de un filtro pasabajos, y la información de la acción de control para la estimación de la intención de movimiento. Adicionalmente, se presenta la aplicación de nuestra propuesta en el algoritmo de detección de caras, en el cual, la robustez se incrementa al ser implementado a partir de la secuencia estable de vídeo.Peer ReviewedPostprint (published version